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Abstract 

Many processes must complete in the presence of failures. Different 
systems respond to task failure in different ways. The system may re- 
sume a failed task from the failure point (or a saved checkpoint shortly 
before the failure point), it may give up on the task and select a re- 
placement task from the ready queue, or it may restart the task. The 
behavior of systems under the first two scenarios is well documented, 
but the third (RESTART) has resisted detailed analysis. In this paper 
we derive tight asymptotic relations between the distribution of task 
times without failures to the total time when including failures, for 
any failure distribution. In particular, we show that if the task time 
distribution has an unbounded support then the total time distribu- 
tion H is always heavy-tailed. Asymptotic expressions are given for 
the tail of H in various scenarios. The key ingredients of the analysis 
are the Cramer-Lundberg asymptotics for geometric sums and integral 
asymptotics, that in some cases are obtained via Tauberian theorems 
and in some cases by bare-hand calculations. 
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1 Introduction 



For many systems failure is rare enough that it can be ignored, or dealt 
with as an afterthought. For other systems, failure is common enough that 
the design choice of how to deal with it may have a significant impact on 
the performance of the system. Consider a job that ordinarily would take a 
time T to be executed on some system (e.g., CPU). If at some time U < T 
the processor fails, the job may take a total time X > T to complete. We 
let F, G be the distributions of T, U and H = Hf,g the distribution of X 
which in addition to F, G depends on the failure recovery scheme. 

Many papers discuss methods of failure recovery and analyze their com- 
plexity in one or more metrics, like restartable processors in Chlebus et al. [7|, 
or stage checkpointing in De Frisco et al. [8], etc. There are many specific 
and distinct failure recovery schemes, but they can be grouped into three 
broad classes: 

RESUME, also referred to as preemptive resume (prs); 
REPLA CE, also referred to as preemptive repeat different (prd) ; 
RESTART, also referred to as preemptive repeat identical (pri). 

The analysis of the distribution function H{x) = P(X < x) when the policy 
is RESUME or REPLACE was carried out by Kulkarni et al. [II], [E]. In 
the RESUME scenario, if there is a processor failure while a job is being 
executed, after repair is implemented the job can continue where it left off. 
All that is required mathematically is to remember the state of the system 
when failure occurred. If repair time is an issue then the number of failures 
before final completion must also be considered. In what follows, we ignore 
the time for repairs, with the knowledge that this can be properly handled 
separately. In the REPLACE situation, if a job fails, it is replaced by a 
different job from the same distribution. Here, no details concerning the 
previous job are necessary in order to continue. 

The work by Kulkarni et al. [13], [IS]) and Bobbio & Trivedi [3] clearly 
suggests that if F is phase- type or, more generally, matrix-exponential ([16], 
[I], [2]), and G{u) = F{U > u) = e"^", then H for the RESUME and 
policies can also be represented by matrix-exponential distribu- 
tions. This means that they could be analyzed entirely within a Markov 
chain framework. 

However, the RESTART policy has resisted detailed analysis. The total 
time distribution H under this policy was defined and examined through 
its Laplace transform in Kulkarni et al. [H], [l5]. They were able to show 
that it definitely was not matrix-exponential, i.e., the Laplace transform 
cannot be rational, and therefore it cannot be solved in the Markov Chain 
framework. However, by numerically taking the inverse Laplace transform 
(see Jagerman [lO]), Chimento &: Trivedi [6j (following a model proposed 
by Castillo [5]) were able to find the RESTART time distribution for a few 
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cases, for a limited range of the total time (x < SET). The method seems 
to be unstable for larger x. It is this problem that interests us here. 

There are many examples of where the RESTART scenario is relevant. 
The obvious one alluded to above involves execution of a program on some 
computer. If the computer fails, and the intermediate results are not saved 
externally (e.g., by checkpointing)^ then the job must restart from the be- 
ginning. As another example, one might wish to copy a file from a remote 
system using some standard protocol as FTP or HTTP. The time it takes to 
copy a file is proportional to its length. A transmission error immediately 
aborts the copy and discards the partially received data, forcing the user to 
restart the copy from the beginning. Yet another example would be receiv- 
ing 'customer service' by telephone. Often, while dealing with a particular 
service agent, the connection is broken. Then the customer must redial the 
service center, and invariably (after waiting in a queue) end up talking to a 
different agent, and have to explain everything from the beginning. 

In our previous paper (Sheahan et al. [18]), we derived an expression for 
the Laplace transform of the total time distribution H for the RESTART 
policy with exponential failure rate, [5. We used it to get an expression for 
the moments EX^ of the total time. ^From this we were able to argue that 
if the task-time distribution has an exponential tail, then X has infinite 
moments for £ > a = A//3, where A is the rate of the exponential tail (i.e., 
F{t) ~ ce"'*'*). This in turn implies that roughly H{x) ~ c/x", i.e., X is 
power-tailed. 

This can have important implications, particularly in applications where 
the time to finish a task is bounded by necessity. If a task takes too long 
to complete it must be aborted, and an alternate solution provided. In such 
applications it may be important to know H(x), for that is the probability 
that a job will be aborted. Power tails and heavy tails, generally, have a 
small but non-negligible probability of lasting for many, many times the 
mean, and thus H{x) for large x can be important. 

In this paper we derive the asymptotic behavior of H{x) as x — oo under 
more general assumptions than in [18] and in sharper form in a number of 
important cases. As a first guess, one could believe that the heaviness of H 
is determined by the heaviness of F and/or G. However, it turns out that 
the important feature is rather how close are F and G. This is demonstrated 
in a striking way by the following result for the diagonal case: 

Proposition 1.1 IfF = G, then Hix) ~ — . 

^x 

Here ^ = 1/Ef7; we assume throughout in the paper that > and, for 
convenience, that F, G have densities /, g (this assumption can be relaxed 
at many places but we will not give the details). It is notable that no 
other conditions are required for Proposition 11.11 in particular no precise 
information on how heavy the common tail F = G \s\ 
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The assumption that the task time distribution F and the failure time 
distribution G be identical of course lacks interpretation in the RESTART 
setting. Thus, Proposition 11.11 is more of a curiosity, which is further il- 
lustrated by the fact that a proof can be given which is far simpler than 
the our proofs for more general situations (see Section [6]). Nevertheless, the 
result indicates that the tail behaviour of H depends on a delicate balance 
between the tails of F and G. We will also see that making F heavier makes 
H heavier, making G heavier makes H lighter. However, except for the case 
when F has a finite support, H is always heavy-tailed: 

Proposition 1.2 Assume that the support of F is unbounded. Then 
e^^H{x) — > oo for any e > 0. 

In general, we will be able to obtain sharp asymptotics for H[x) when 
F and G are not too far away. The form of the result (Theorem 12. 2p is 
regular variation of H. For example, the following result covers Gamma 
distributions: 

Corollary 1.1 Assume f,g belong to the class of densities of asymptotic 
form ce~'^^t'^~^ , with parameters Xp, a f,cf for f andXcaccc forg. Then 
H{x) ~ CHlog°'^~°'""'^ x/x"'" , where an = Xp/Xc and 



CFT{aH)X'^ 



a[{ — l—ap+a[{aQ 



Numerical illustrations are given in for ac = 1 (i-e., G exponential) and 
show an excellent fit. 

When F and G are more different (say F has a power tail and G is 
exponential), we will derive logarithmic asymptotics for H. We will see 
forms varying from extremely heavy tails like 1/ log" x over power tails 
to moderately heavy tails like the Weibull tail e~^ with /3 < 1. 

The proofs of the paper are based on the representation 



N 

X = T + S where N = inf {n : Un+i > T} , 5 = ^ C/i , (1) 

i=l 

and Ui,U2,--- are the succesive failure times (assumed i.i.d. with distri- 
bution G and independent of T). More precisely, we will use that given 
T = t, S{t) = Ui is a compound geometric sum for which exponential 
Cramer-Lundberg tail asymptotics is available, and uncondition to get our 
final results. In Section [2] we state our main results, except for the case of 
a bounded task time T which is treated in Section [3l The analysis there 
departs from a careful study of the case T = t. Section H] is devoted to the 
proof of the following lemma, which is the key to the unbounded case: 
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Lemma 1.1 Let jj, = 1/EJ7 and define 



roo 

I±{x,e) = / exp{-fiG{t)x{l±e)} f{t)dt 
Jo 

Then for each e > 0, 

, H(x) , H(x) 

1 — e < iim mi — < lim sup — r- < 1 + e . 

2:^00 I+(x,e) x^oo I-{x,e) 

This lemma essentially reduces the investigation of the asymptotics of H{x) 
to the (not always straightforward!) purely analytical study of the asymp- 
totics of /+(x,e) and I_(x,e). Indeed, we will see in Section [5] that once 
this is done, one is most often able to obtain the logarithmic asymptotics 
of H{x) by letting e J. 0, and in some cases even the sharp asymptotics. 
Finally, Section [6] contains some concluding remarks. 



2 Statement of Main Results 

Except for Proposition 13.21 we will assume throughout the paper that the 
support of F is infinite. 

We shall use the concept of logarithmic asymptotics familiar from large 
deviations theory and write f{t) ~iog g{t) for two functions f,g > with 
limits at t = 00 if log f{t)/ log g{t) ^ 1 as t ^ 00. We then consider the 
following distribution classes: 

^i: fit) «iog e-^'\ ^2: fit) «iog 

'^1 : Git) P^^iog e-f'\ ^2 ■■ Git) p^iog ^ 

Note that these definitions do not completely identify the tail behaviour of 
F, G. For example, if ~ ct°'e-'^^\ then G G ^1, but one cannot identify 
c,a, and if fit) ~ clog^ t / 1°'~^^ , then F G ^1, but one cannot identify c, /5. 

Note also that / G ^2 implies that Fit) ~iog and that a sufficient 

(but not necessary) condition for G G is that git) is regularly varying 
with index —(5 — 1. 

Similarly to the definition of / ~iog g', we will write / ~iogiog 9 if 

log(-log/(t)) ^ ^ 

log(-log5r(t)) 

See further part (1:2) of Theorem 12.11 and Remark E) in Section [6l 

With these distribution classes, we obtain a complete description of the 
logarithmic asymptotics of -ff(x) except for the case / G ^1, G G 1^2 where 
we only obtain ~iogiog asymptotics.: 
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Theorem 2.1 

(1:1) Assume F € ^i, G € ^^i. Then H{x) ^\og exp |— cn log^^^ x| where 
0ii = v/l, cii = a//3^"; 

(2:2) Assume F e ^2, G e ^2- T'/ien F(x) psiog = exp {-6I22 logx} 

where 6*22 = 

(2:1) Assume F e ^2, G G ^1. Then'H{x) ^\og — \ = exp {-6*21 log log x} 

where 621 = ot/^; 

(1:2) Assume F e ^1, G G ^2- ^/len F(x) f«iogiog expj-x^i^j ^/^g^g 
^i2 = W(/? + ^)e(0,l). 

Note that the asymptotic expressions are in agreement with H[x) being 
necessarily heavy-tailed, cf. Proposition 11.21 E.g. the asymptotics in part 
(1:2) is as for the heavy-tailed Weibull distribution, and the one in part (1:1) 
as for regular variation if On = 1 and as for the lognormal distribution if 
011 = 2. 

Generalizing [TH], we will also show: 

Proposition 2.1 Assume g{t) > cf{t)^^'^~^ for all large t, where a,e > 0, 
c < 00. Then x°'H{dx) < 00. If g{t) < cf{t)^^" for all large t, where 
a > 0, c > 0, then x°'H{dx) = cxd. 

For example, the mean of H is finite when the tail of F is slightly lighter than 
the tail of G and infinite when it is equal or or heavier. Similar, checking 
finite variance amounts to a comparison of F and G . 

Our main results on sharp asymptotics is as follows (here and in the fol- 
lowing, slowly varying functions are assumed to have the additional property 
of being bounded on compact subsets of (0, 00)): 

Theorem 2.2 Assume 

fit) = g{t)G{tf-^Lo{G{t)) (2) 
where Lq{s) is slowly varying at s = 0. Then 

r(/3) Lpjl/x) 
~ —p ^^00. (3) 

Here f{x) ~ g{x) means f{x)/g{x) 1. For example: 

Corollary 2.1 Assume f,g belong to the class of regularly varying densities 
of the form L{t)/t^^°' where L is slowly varying, with parameters ap, Lp for 
f and acLc for g. Then H{x) = Lh{x) /x"^" , where an = apjoLQ and 
Lh is slowly varying with 

r(aH)a^"-^ Lp{xy»o) 
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Corollary 2.2 Assume f,g belong to the class of densities of the form 
e~'^*''t"L(t) where L is slowly varying att = oo, with parameters Xf,0!f, Lp 
for f and Xg,o:g,Lg for g, and the same r] = rjp = r]G- Then H{x) = 
Lh{x) / x"^" , where an = Xf/Xq and Lh is slowly varying with 



Lh[x) ~ 1—, -log X —, — 

where w = ap/r] + auif] — ac — l)/r? + l/r/ — 1. 

Of course Corollary 12. II is close in spirit to Theorem 12. ll f 2:2): the conditions 
are slightly stronger, but so are also the conclusions. The difference be- 
tween Corollary 12.21 and Theorem 12.1( 1:1) is somewhat more marked, since 
Corollary 12.21 only applies when r]p = r]G (i-e., = 7 in the notation of 
Theorem 12. H where = 7 is not required). 

Finally consider ordering and comparison results. One expects intu- 
itiyely a heayier tail of F to lead to a heayier H. The precise statement of 
this is in terms of stochastic order (s.o.): 

Proposition 2.2 Assume given two task time distributions Fi, F2 such that 
Fi is smaller than F2 in s.o., that is, Fi{t) < F2{t) for all t. Then also 
Hp^^G ^ Hp^^G 'in s.o. for any fixed G. 

This follows from ([T]) and the coupling characterization of s.o. ([E]) by 
noting that if Ti < T2, then (in obyious notation) N(Ti) < N{T2) and 
hence S{Ti) < S{T2), X{Ti) < X{T2) 

Similarly, one expects a lighter tail of G to lead to a larger X. Howeyer, 
stochastic ordering cannot be inferred since if Gi, G2 are giyen {F is fixed) 
such that Gi is smaller than G2 in s.o, then on one hand is smaller for 
G2 than for Gi for any t but on the other the Ui{t) are larger. Howeyer, we 
will establish an asymptotic order under a slightly stronger condition than 
Gi being smaller than G2 in s.o.: 

Proposition 2.3 Assume that Gi is smaller than G2 in s.o. and that in 
addition limsup^_^Gi{t)/G2{t) < 1. Then for F fixed, 

lim sup = < 1 . 

t^co Hp^Gi {t) 

3 Geometric Sums. Bounded Job Time T 

Giyen T = t, the number N(t) of restarts is geometric with failure parameter 
G{t) = ¥{Ui <t) = l- G{t) so that 

F{N{t) >n) = Git)"", EN{t) = £1*^ ^ 



G{t) G{t) 
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It follows that given T = t, we can write 

N{t) 

X = t + S{t) where 5(t) = ^ Ui{t) 

1=1 



(here = means equality in distribution) where the Ui{t) are independent of 
N{t) and i.i.d. with the distribution Gt being G truncated to [0, t), that is, 

with density G{t)-^ g{s)I{s < t) at s. Then X = T + S{T) so that 

/•oo 

H{x) = I F{S{t) > x-t) f{t)dt. (4) 
Jo 

This is the basic identity to be used in the following. 

A first implication of (j3|) is that asymptotic properties of geometric sums 
must play a role for the asymtotics of H{x). We shall use Cramer-Lundberg 
theory, cf. [2], [19], more precisely the following result: 

Proposition 3.1 Let Vi, V2, . . . be i.i.d. with common density k{v), G N 
an independent r.v. with F{N = n) = (1 — p)p"', and S = Vi + ■ ■ ■ + Vn- 
Then F{S > x) ~ Ge~^^ where 7 is the solution of p e^^ k{y) dy = 1 
and C = (1 — p)/"iB where B = p ye^yk[y)dy. Furthermore, letting 

, . . , e""=K{x) , , e^'^Kix) 

C-{x) = im -jao , c+(xj = sup 



o<z<x,K{z)>o e^/ykiy) dy o<z<x,'K{z)>o 

f^e^ykiy)dy, 
we have the Lundberg inequality 

c_(x)e-^^ < F{S>x) < c+(a;)e-^^ 

for all x. 

For a proof, see Willmot & Lin [19] pp. 108-109. Alternatively, Proposi- 
tion [3T] follows easily from 

>x) = F{N>l,Vi>x)+ [ F{S > x-y)F{N >l,Vi (£dy) 

Jo 

= pK{x) + I F{S>x- y)pk{y) dy , 



which is a defective renewal equation to which standard theory applies (see 
[2] V.7 and also [1] III.6c). 

Corollary 3.1 In the RESTART setting, F{S{t) > x) r-. C(t)e-'^W^, 
X 00, where 7(t) > is the solution of Jl^e^^^^y G(dy) = 1 and G{t) = 
G{t)/j{t)B{t) where B{t) = j^ye^^^'^y g{y) dy . This estimate is uniform in 
ti < t < t2 for given < ti < t2. Furthermore, 

e-7(i)ie-7W^ < r{S{t)>x) < e-^W*. 
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Proof. The first statement is a trivial translation of the first statement of 
Proposition 13. li For the two-sided Lundberg inequality, note that in the 
RESTART setting with K{y) = Kt{y) = P(C/(t) < y), the integral in the 
definition of c_(x) extends only up to t which gives c_(x) > e~'>'*, and 
that Cj^{x) < 1. For the uniformity of the Cramer-Lundberg approxima- 
tion, appeal to uniform estimates of the renewal functions corresponding 
to the e^^^^yRtidy) as given, e.g., Kartashov [12], [13] (see also Wang & 
Woodroofe ^). □ 

In particular, Corollary 13.11 settles the case of a fixed job size: 
Corollary 3.2 Assume T = to and G(to) > 0. Then 
H{x) ~ C(to)e^(*o)*Oe-^(*»)^ . 

In the case of an infinite support of /, Corollary 13.21 shows that the tail 
of H is heavier than e"'''*^*-*^ for all t (note that j{t) | as t — > oo; more 
precise estimates are given later). This observation proves Proposition 11.21 

If T is random, we need to mix over t with weights f{t). If the support of 
/ has a finite upper endpoint to, Corollary 13.21 suggests that the asymptotics 
of H{x) is not too far from e""^^*")^, and in fact, we shall show: 

Proposition 3.2 Assume that the support of F has upper endpoint < 
to < oo, that G(to) > and that 

f{t) ~ A{to-tr, tUo, (5) 

for some < ^4 < cxo and some a > 0. Then 

AB{to)'^G{to)r{a + 1) e-^(*o)^ 



7(to)e°T(*o)5(to)"+^ X 



Proof. For simplicity of notation, write B = B{to), 7 = 7(to) etc. 

It is easy to see that 7(t) is continuous and differentiable in t. To obtain 
the asymptotics as t j to we write 



1 = / e-^^'iyCidy) = / e^^*^^G(dy) - / e''W?/G'(dy) 
Jo Jo Jt 

' ° ^ly [1 + (^(t) _ j)y] G{dy) - (to - t)e^*«9(io) + o(7(t) - 7) 







so that 



1 + (7(0 - 7)^ - (to - t)e^*«g(to) + o(7(t) - 7) 



7(t) - 7 ~ (to - t)D (6) 
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where D = e^^° g{to) / B . Appealing to the uniformity in Corollary 13. 1^ we 
therefore get 

to /"to 

7X^ 



H{x) = [ ° Zt{x - t)f{t) dt = / " Zt{x - t)f{t) dt + o(e 
= ri(e) r° Ce-^W(^-*)^(to -t)"dt + o(e-^^) 

J to-e 

= r2(e)ACe-^(^-*") ^ e-(^W-^)^(to - 0° dt + o(e-^^) 

J tn—e 



where Zt{x) = P{S{t) > x) and ri(e), r2(e), . . . — > 1 as e [ 0. Thus substi- 
tuting y = {'~f{t) — j)x and noting that dy ~ —Ddt by ©, we get up to the 
o(e~'^^') term that 

H{x) = r2ie)ACD-"-'—^^j^ y^e'^dy 

Letting first a; — > oo, next e | 0, and rewriting the constants completes the 
proof. □ 

4 Proof of Lemma 11.11 

We will need the asymptotics of the Cramer root 'y{t): 
Lemma 4.1 As t oo, 7(t) ~ fiG{t). 
Proof. Consider 

*(e^(% _ 1 _ Gidy) = Git) - 7W(l//« " o(l)) • (7) 



The non-negativity of the l.h.s. yields 7(t) = 0[G{t)). Since tG{t) because 
of > 0, the integrand in ^ can therefore be writtes as 7(t)ye(y, t) where 
e{y, t) — > uniformly in y < t as t — > oo. Therefore ([7]) equals 7(t)o(l) 
which shows the assertion. □ 

Proof of Proposition 11.21 Given e > 0, choose to such that 7(to) < cf. 
Lemma Hm and a so large that 7 (to + a) < 7 (to)- We then get 



liminfe'^'';ff(x) > liminf e^(*o)^;ff(2;) > liminf / 

a:— >oo x— >oo x— >oo Ji^j^^ 6 



[S{t) > x) 



> / liminf dt = / oo-/(t)dt = oo 



where we used Fatou's lemma in the third step and Corollary 13.11 in the 
next. □ 
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Lemma 4.2 For any to < oo, P(X > x, T < to) goes to zero at least 
exponentially fast. 

Proof. By Lundberg's inequality, 

F{X > x,T <to) < F{to)F{S{to)>x-to) < F(to)e-^(*o)(^-*«) . □ 

Lemma 4.3 Define = Ui{t) + - ■ • + [/„(*), m(t) = EU^{t) = E[Ui \ Ui < 
t] . Then 

¥(^\Sn{t)/n- m{t)\ > = o(l), n ^ oo, 
where the o(l) is uniform in t > 6 for any 6 > 0. 
Proof. Define Ui{t,n) = Ui{t)l{Ui{t) < n). Then, in obvious notation 

ft 

W{Sn{t,n) ^ Sn{t)) < nF{Un{t,n)^Un(,t)) < -—F{U>n) 

Lr[t) 

goes to zero uniformly in t > 6 because of EC/ < oo. Further, 

1 1'^ 2x 2 1'^ X 

-Wi{t,nf = / —¥{U^^t,n)>x)dx< —— / -P(C/ > x) dx = o(l) 

n Jo n ^ G{t) Jo n ^ 



uniformly in t > 6, as follows by dominated convergence with P(C/ > x) as 
majorant. Hence by Chebycheff's inequality, 



|5„(t,n)/n-m(t,n)| > ej < ' = o(l) 

uniformly in t > 6. Also 



m{t)-m{t,n) = EUi{t)l{Ui{t) > n) < -^EUl{U >n) = o(l) 

uniformly in t > 5. Putting these estimates together completes the proof. 

□ 

Proof of Lemma 11.11 Given e > 0, it follows by Lemma 14.11 that we can 
choose to such that ^(t) > fiG{t){l — e) and (since G has finite mean) 
7(t)i < log(l + e) for t > to . Thus by the upper Lundberg bound and 
Lemma I4.2|, 

/•oo 

H{x) = / P(5(t) > x-t)/(t)dt + o(e-™) 

Jto 
/•oo 

< / f{t)dt + o(e-"^) 
Jto 

< (1 + e) / e-'^^W(^-^)^/(t)dt + o(e-''^) 



to 

rx\ 



< (l + e)/_(x,e) + o(e 
11 



for some r > 0. Now note that H{x) decays slower than e by Proposition 

m 

For the lower bound, let e > be given and let ei,e2 > satisfy (1 + 
e)(l — ei) > 1 + 62 > 1- Lemma 14.31 implies that there is an no such that 

F {Sn{t) > nm{t) {1 -2ei)) > 1-e 

for all n > uq and all t > to- Since m{t) 1//U, we have then also 

P(5„(t) >n(l-ei)//i) > 1-e 

for all n > no and all t > to- Choose next such that e"^^"*"^^^^ < 1 — 
for < ^ < 5o- Replacing to by a larger to if necessary, we may assume 
G{t) < 'qq for t >to and get 

H{x) > 



poo 
Jto 


F{S{t) 


>x)f{t)dt 


(1- 


/•oo 
Jto 


F{N{t)>xfi/{l-ei))f{t)dt 


(1- 


/•oo 


G(tf'^/(i-^i)/Wdt 


(1- 


/•oo 
Jto 


exp {-G(t)x;u(l + 62)7(1 - ei)} /(t) dt 


(1- 


/•oo 
Jto 


exp{-G(t)x/i(l + e)}/(t)dt. 



Since the last integral differs from /-|_(a;,e) by a term which goes to zero 
exponentially fast and hence is o{H(x)), the proof is complete. □ 
Proof of Proposition [TTTl When F = G, we have dG(t) = —f{t). Hence 
1 



I^U^e) = — ^ e-''G{tMi±e) ^ _^ ^(l_e-MG{toMl±.)^ 

' ' lnx{l±€) ito t^x{l±e)^ ' 

1 



oo 



/ix(l ± e) 

The assertion now follows easily from Lemma 11.11 by letting first x — > cx3 
and next e — > 0. □ 
Proof of Proposition 12. li Under the assumptions of the last part of the 
Proposition, G{t) < ciF(t)^/" for t > to and hence 

/•oo fOO 

/ x'^Hidx) = a I x'^-^H{x)dx 
Jo Jo 

/•oo POO 

> C2 / / e-^^W^/(t)dt 

Jo Jo 



/•oo 1 poo 1 



1 1 

C4 / -dy = oo, 
'o y 
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proving the last part of the Proposition. For the first part, we get similarly 

1 

x"i?(dx) < C5 + C6 / ^— -dy < oo . □ 

Jo y 

Proof of Proposition [231 Write l].{x,e), /xi when G = Gi and similarly for 
G2- We may assume Gi 7^ G2. Then the s.o. assumption implies ni < 112- 
Hence if e > is so small that /ii(l + e) < /X2(l — e), we have + e) 

< MiG2(i)(l — e) for ah t. We then obtain 

HgA^) > (l-e)/i(x,e) > (l-e)/!(x,e) > 

where the outer inequalities are asymptotic and the inner one exact. Let 
first X — > cxo and next e ^ 0. □ 



5 Proofs: Integral Asymptotics 

Lemma 5.1 For given constants a,b,j,r] > 0, 



I = ^°°exp{-e-''*''z-ai^} 



as z —> 00. 



Proof. Let c = ab~'^/"', ti = {log z/b)^/"' and let /i,/2 be the contributions 
to I from the intervals (ti,oo), resp. {tQ,ti). In Ii, we bound the first term 
in the exponent below by so 

Jti 

In I2, we substitute y = e~^^'^ z. Then 

t = (logz-logy)i/^6-^/^, dt = - — (logz -logy)^^^-^b-^/^dy 
so that I2 becomes 

J -(log2;-logy)^/'^"^exp|-y-c(log2;-logy)''/'^| dy 

We split this integral into the contributions 13,14, from the intervals [1,2), 
[2,e~^oz). Here 

logi/^-ize-'='°s'"'"^ f-e-^dy e-^'^^'^'' \ 

Ji y 
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For I4, we write q = ry/7, h{y) = —y/2 + clog*^ z — c(log z — logy)'^. Then 

%) = -y/2 + cq f (lQg^-log^/)^"' dy < -y/2 + cq\og^-^z\ogy. 

The r.h.s. is maximized for = 2cq\og'^~^ z, where 

h{yz) = log«~-^2;0(loglogz) = o(log*2;). 

Hence 

Ji y 

Adding these estimates shows that e~"^ ''^^ log''/'' z asymptotic upper 
bound in the logarithmic sense, and that it is also a lower one follows from 
the estimate for J3. □ 

Lemma 5.2 For given constants a, h, 



f"e-t-^^^dt 
Jti 



to 

Proof. Substitute y = t~^z to get 

r -t-p, 1 /■v"^ y"//3-i r(«/^ 1 

Lemma 5.3 For given constants a, 6, 7 > 0, 

/ = / exp <^ -e-^^\ - (a + 1) log t \ dt ^i^g , , 
J to ^ ^ log^'^z 

as z —* 00. 

Proof. Let again ti = ti{z) = {\ogz/hY^^ (then e~^*i2; = 1) and let /i,l2 
be the contributions to I from the intervals (ii,(X)), resp. (io,ii)- In /i, 
< e-''*''z < 1 and so 



e-i 



< h < 



a{\og{z/h)Y'' a{\og{z/b)Y'' ' 

For h, let r2(i) = e-^*^z + (a + 1) logt, s(t) = t'^e"^*^. Then 

r'^it) = -67i^-ie-^*% + ^ = ^[-lns{t)z + {a + l)] . 
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Since s is continuous with s{to) > and s{t) is monotonically decreasing for 
large t with hmit 0, we have s{t) > s{ti) = \og{z/b)/z for all to < t < ti 
and all large z because of ^1(2;) 00. Hence r'^{t) < ioi to < t < ti and 
all large z so that 



h = Te-'-^Wdt < (ti - to)e-'-^(*i 

J to 



{log{z/b)) 



a/7 ■ 



Putting the upper bounds for Ii , I2 together and noting that (log(z/6)) "'^'^ paiog 
log°-/"f X shows that log~°'^"' z is an upper bound in the logarithmic sense, and 
that it is also a lower bound follows from the lower bound for /i. □ 

Lemma 5.4 Let r) > be fixed. Then for any a,b> 0, 

/ = ^ expj-rt-ai''} di «iog exp |-ci2(a,6)/i2(fe)| 

as z ^ 00 where 

eu{b) = r]/{b + r,), cMa,b) = a'-'^'[{r]/b)'-'^'^'^ + (b/ri)'^'] . 
Proof. We choose ti = t\{z) to minimize f{t) = t~^z + at^ which gives 

t, = (tey/<'+", ^(,,, = c„(a,6)/"<'). 
Vary/ 

Thus the claim of the lemma can be written as I ~iog e~'^^*^^. As lower 
bound, we use 

expj-rt-at"} di > exp - a(ti + 1)"} ^^log e'^^*^^ 

where in the last step we used (t + 1)'' = + o(l)). For the upper 
bound, we write I = Ii + I2 + 1^ where h, h, h are the contributions from 
the intervals to < t < ti, ti < t < Kti, resp. Kti < t < 00 where K 
satisfies aK'^ > 012(0,6). Since / is decreasing in the interval to < * < 
and increasing in ti < t < cxd, we have Ii < tie~^^^^^ ^log /(^i) a^id I2 < 
{K - l)iie-^(*i) «iog e-^(*i). Finally, 



h < / e-"*" dt «iog e-"^"*? 



J 

JK 

can be neglected because of the choice of K. □ 
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Proof of Theorem \2.1\ In (1:1), we can choose to such that G{t) < e~^^' and 
f{t) > e""*'', t > Iq, for any given h < j3 and a > a. With I±{x,e) as in 
Lemma ll.lt we then get 

log/+(x,e) 



hm inf ■ , 



11'°° — 
= hm inf log / exp { -^G(t)x(l + e) } f{t) dt 

x^oo -logWTx J to 

> hminf —, — log / exp |-ue~^*^x(l + e) - at"') dt 

- ™ -log^/Tx Jto ^ J 

x^oo -log^'/'^X 

where we used Lemma 15.11 with z = fix{l + e) in the third step. Letting 
a I a, b ] a shows that e~'^^^ log^n x jg asymptotic lower bound in the 
logarithmic sense. That it is also an asymptotic upper bound follows in 
the same way by noting that the contribution to H{x) from (0, to) goes to 
zero exponentially fast by Proposition 11.21 for any to and hence is negligible 
compared to e~'^ii^°s ^. 

Parts (2:2) and (2:1) follow in a similar way from Lemmas 15.21 and 15.31 
For (1:2), we choose b > (3, a < a and get 

. log(-logF(x)) . log(-log/+(x,e)) 
hmmi ^ — - > iimmi 

x^oo log(- loge~^ ^^) du^ogx 

= liminf— f-log/ exp |-^G(t)x(l + e)| /(t) dt 

x^oo 6*12 log j;V Jto 

> liminf— f-log/" exp |-//t~*3;(l + e) - at'') dt 

x^cc 6^12 log a; V Jto ^ ^ 

. ^ log(ci2(a,6)(^x(l + 6))^"('')) eu{b) 
= hmmf — = — . 

x^oo 6^12 log X 012 

Letting a ] a, b I a shows that e~^^^^ is an asymptotic lower bound in the 
~iogiog sense. That it is also an asymptotic upper bound follows similarly. 

□ 

Proof of Theorem \2.2\ In Lemma [TTT| we insert ([2]) and substitute s = Git) 
to get 

rso 

I± = I exp|— sx;u(l ± e)|s^~^Lo(s) ds . 
Jo 

where sq = G ^(to). Then by Karamata's Tauberian theorem ([3l Theorems 
1.5.11 and 1.7.1]), 
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Let e i 0. □ 

Proof of Corollary^ WehaveG(t) = where L^(t) ~ LG{t)/{aG+ 

1) asi ^ oo. Then holds with/? = ap/aG andLo(G(t)) = Lpit) / LGit)^^'^' 
Note that Lq is s.v. because the inverse of a s.v. function is again s.v. (Op. 
28]) and because the composition of two s.v. functions is again s.v. Further, 



([31 p. 29]) Lf{G ^{s)) Lf{s~^/"'=^) as s i and similarly for Lg. Thus, 
Lo(5) ~Lf(5-i/-G)(„^ + l)/3~i/L^(,-i/ao). □ 

Proof of Corollary \2.2[ We have 

G(t) = / e~^GS/''y«G^^(y)dy ^ e-^Gt^t''G+^-'nGLG(t) 
Jt V^G 

(e.g., substitute z = Q~^ay'^ ^nd apply Karamata's theorem). /,From this it 
is easy to see that 

In particular, Lp{G ^(s)) ~ Lp(^{— log sY^^^ and similarly for Lg- Thus 
if Lq is defined by ([2|) with f3 = Xp/Xg, we have 

Lo(s) ~ r/'^ "(-logs)"" 



4((-logs)i^) 

which in particular shows that Lq is s.v. at s = 0. Now just replace s by 
1/x and /? by ajy to obtain the Corollary. □ 

Corollary 11.11 is a special case of Corollary 12. 2[ 

6 Concluding Remarks 

A) The representation ([T]) easily gives a proof of the asymptotics H{x) ~ 
l/fj,x for the diagonal case F = G (Proposition II. ip . Indeed, the event 
N = n corresponds to the ordering Ui < T, . . . ,Un < T, Un+i > T. Since 
the n + 2 random variables T, C/i, . . . , C/„, Un+i are i.i.d. when F = G, we 
therefore have F{N = n) = l/(n + 2)(n + 1), P(iV > n) = l/(n + 2) (we are 
grateful to Clive Anderson for a remark triggering this observation). One 
can now argue that in order for X to be large, N has to be large which in 
turn is only possible if T is large. Then the distribution of the Ui is close to 
G, so that the geometric sum is approximately N/fj,. Since ET = 1/ fi < oo 
implies that the tail of T is lighter than 1/x, we therefore get 



¥{X > x) « ¥(y2u> xBbigr) « F{N > fix) 
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Th argument is not hard to make rigorous, but we omit the details since 
the further results of the paper are much more general than Proposition ll.il 
and require different proofs. 

B) An application of the above results occurs in parallel computing. Assume 
that a job of length NT is split into N subjobs of length T which are 
placed on A'^ parallel processors (A^ may run in the order of hundreds or 
thousands). If one processor fails, the corresponding subjob is restarted on 
a new processor. With Ai, . . . , the total times of the subjobs, the total 
job time is then M^v = max(Ai, . . . , Atv). The asymptotic behaviour of 
Mtv as A^ — > oo is available from extreme value theory once the tails of the 
Xn is known, which is precisely what has been the objective of this paper. 

Whether this asymptotic scheme is the most relevant one is, however, 
questionable. One could equally well assume the job length fixed at T and 
the length of the A^ subjobs to be T/N, and intermediate possibilities. This 
leads into specific questions on extreme value theory in a triangular array 
setting, which are currently under investigation. 

C) An alternative to the Cramer-Lundberg theory for geometric sums that 
has been one of our main tools is what could suitably be called Renyi theory, 
cf. [llj . One considers there a weak convergence triangular setting where 
still X ^ oo but the parameters of the geometric sum depend on x; this is 
also related to the heavy-traffic or diffusion limit setting of risk and queueing 
theory, cf. e.g. p] and [2] X.7. Renyi theory (e.g. |llj) provides the following 
alternative to Proposition 13.11 

Proposition 6.1 For each x, let Vi{z),V2{z), . . . be i.i.d. with common 
density k{v;z) and N{z) G N an independent r.v. with ¥{N{z) = n) = 
(1 - S{z) = Vi{z) + ■■■ + Vn{z). If p{z) ^ 1 as z ^ oo and 

Vk{z) ^ V, KVk{z) — > 1/fi for some r.v. V with finite mean then 
— p{z)S{z) has a limiting standard exponential distribution. 

Corollary 6.1 In the RESTART setting, fiG(t)S{t) has a limiting standard 
exponential distribution as t ^ oo. 

The implication is that 

F{fiG{t)S{t) >y) ^ e-y (8) 

for any fixed y. Noting that pG{t) ~ ^{t) and replacing y by 7(t)x, this 
suggests P(5(t) > x) PS e"'''^*)^, i.e. the Cramer-Lundberg approximation. 
Of course, the derivation is not rigorous since ([H]) requires that y is fixed. 
Nevertheless, it is indeed possible to derive some of our results from ([8]). The 
main reason that we have chosen Cramer-Lundberg asymptotics as our basic 
vehicle is that simple bounds are available (Lundberg's inequality) which is 
not the case for Renyi theory. 
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D) Since H is a, mixture of the Ht given by Ht{x) = P(5'(t) + t < x) and the 
tail of Ht obeys the Cramer-Lundberg asymptotics, we are deahng with the 
problem of determining the tail of a mixture where the tails of the mixing 
components are known. Looking for literature on this problem, we found a 
set of papers emerging from reliability and survival analysis ( Finkelstein & 
Esaulova [9j and references there) which suggest our logarithmic asymptotics 
results but do not prove them because the assumptions are too stringent to 
apply to our setting. 

E) The ~iogiog asymptotics in part (1:2) identifies 0i2 as the correct ex- 
ponent to X in logH{x), but does not allow sharpenings like H{x) R^iog 
g-ci2x 12^ H{x) ~iog e~^^^ etc. Inspection of the proof shows that 
to obtain such strengthenings, one needs first of all to be able to replace the 
b in Lemma 15.41 with a fixed value /? rather than considering 6's arbitrarily 
close to p. This would be the case if, e.g., one assumed G to be regu- 
larly varying with index —f3 rather than just G{t) f»iog t~^. This does not 
appear to be all that restrictive, but does not suffice since one also needs 
to replace the ±e in Lemma 11.11 with sharper bounds. This amounts to 
second-order asymptotics of the Ht{x), i.e. to obtain second-order uniform 
Cramer-Lundberg expansions which does not appear easy at all. 
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